Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Fix][Zeta] Fix resource isolation not working on multi node #7471

Merged
merged 9 commits into from
Aug 28, 2024

Conversation

chenqianwen
Copy link
Contributor

#7469

Purpose of this pull request

separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

yanggld added 3 commits August 23, 2024 11:52
…hen starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.
…hen starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.
…hen starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.
@github-actions github-actions bot added the Zeta label Aug 23, 2024
@chenqianwen chenqianwen reopened this Aug 23, 2024
@Hisoka-X
Copy link
Member

cc @liunaijie as well.

@Hisoka-X
Copy link
Member

Please add test case.

@Hisoka-X Hisoka-X added this to the 2.3.8 milestone Aug 23, 2024
@liunaijie
Copy link
Member

I check the code with my local env, i miss to submit this part of code, my bad.
thanks @chenqianwen fix this issue.

The current test is only has 1 node, won't have any network transport. so not get exception.
Please also help update the test case, use 2 node as a cluster, thanks.

@Hisoka-X Hisoka-X changed the title [Bug] [resource-isolation] separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched. [Fix][Zeta] Fix resource isolation not working on multi node Aug 24, 2024
@Hisoka-X Hisoka-X added the First-time contributor First-time contributor label Aug 24, 2024
@github-actions github-actions bot added the e2e label Aug 27, 2024
@chenqianwen
Copy link
Contributor Author

I have add one test case named: WorkerTagClusterTest

Hisoka-X
Hisoka-X previously approved these changes Aug 27, 2024
Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if ci passes. Thanks @chenqianwen !

@Hisoka-X
Copy link
Member

Hi @chenqianwen , please retry the failed ci. Thanks.
image

@chenqianwen chenqianwen requested a review from Hisoka-X August 27, 2024 13:56
…e/src/test/java/org/apache/seatunnel/engine/e2e/resourceIsolation/WorkerTagClusterTest.java
Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks @chenqianwen

Copy link
Member

@wuchunfu wuchunfu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, Looking forward to your next contribution, thanks

@wuchunfu wuchunfu merged commit b64a690 into apache:dev Aug 28, 2024
5 checks passed
hawk9821 pushed a commit to hawk9821/seatunnel that referenced this pull request Aug 29, 2024
…7471)

* [Bug] [resource-isolation tag_filter] separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.

* [Bug] [resource-isolation tag_filter] separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.

* [Bug] [resource-isolation tag_filter] separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.

* [Fix][Zeta] Fix resource isolation not working on multi node test case

* [Fix][Zeta] Fix resource isolation not working on multi node test case

* [Fix][Zeta] Fix resource isolation not working on multi node test case

* [Fix][Zeta] Fix resource isolation not working on multi node test case

* Update seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/resourceIsolation/WorkerTagClusterTest.java

---------

Co-authored-by: yanggld <yanggld@digiwin.com>
Co-authored-by: Jia Fan <fanjiaeminem@qq.com>
hawk9821 pushed a commit to hawk9821/seatunnel that referenced this pull request Aug 29, 2024
…7471)

* [Bug] [resource-isolation tag_filter] separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.

* [Bug] [resource-isolation tag_filter] separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.

* [Bug] [resource-isolation tag_filter] separated-cluster-deployment, When starting the worker, specify group=platform, and when submitting the job, specify tag_filter, which is also group=platform, but cannot be matched.

* [Fix][Zeta] Fix resource isolation not working on multi node test case

* [Fix][Zeta] Fix resource isolation not working on multi node test case

* [Fix][Zeta] Fix resource isolation not working on multi node test case

* [Fix][Zeta] Fix resource isolation not working on multi node test case

* Update seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/resourceIsolation/WorkerTagClusterTest.java

---------

Co-authored-by: yanggld <yanggld@digiwin.com>
Co-authored-by: Jia Fan <fanjiaeminem@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants